2024.10.21 19:06:10.842010 [ 340 ] {} Context: Server was built in debug mode. It will work slowly. 2024.10.21 19:06:10.847095 [ 340 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.10.21 19:06:15.397922 [ 340 ] {} Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182 2024.10.21 19:06:16.337396 [ 340 ] {} KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper. 2024.10.21 19:06:16.338621 [ 340 ] {} KeeperLogStore: Removing all changelogs 2024.10.21 19:06:16.340462 [ 340 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.10.21 19:06:16.346901 [ 340 ] {} KeeperStateManager: No state was read 2024.10.21 19:06:16.347041 [ 340 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.10.21 19:06:16.347165 [ 340 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.10.21 19:06:16.399207 [ 607 ] {} RaftInstance: Election timeout, initiate leader election 2024.10.21 19:06:16.496987 [ 340 ] {} Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist 2024.10.21 19:06:16.497195 [ 340 ] {} Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/ 2024.10.21 19:06:16.956001 [ 340 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.10.21 19:06:50.043541 [ 340 ] {} KeeperLogStore: Changelog is shut down 2024.10.21 19:06:53.055852 [ 785 ] {} Context: Server was built in debug mode. It will work slowly. 2024.10.21 19:06:53.061762 [ 785 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.10.21 19:06:57.850984 [ 785 ] {} Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182 2024.10.21 19:06:58.927624 [ 785 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.10.21 19:06:58.934549 [ 785 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.10.21 19:06:58.934684 [ 785 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.10.21 19:06:58.987294 [ 1007 ] {} RaftInstance: Election timeout, initiate leader election 2024.10.21 19:07:00.565070 [ 785 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.10.21 19:13:07.556700 [ 791 ] {ec46268b-b62a-42d8-b1d1-d0bb07b63bfa} executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million: While processing (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery1: While processing 1 = ((SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery1). (TOO_MANY_ROWS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44254) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 = (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x000000001b8a5e39 in /usr/bin/clickhouse 8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:234: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001ee9a1c3 in /usr/bin/clickhouse 9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1786: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001eea8aa6 in /usr/bin/clickhouse 10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee55d6c in /usr/bin/clickhouse 11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee7c2ff in /usr/bin/clickhouse 12. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x000000001cbd196b in /usr/bin/clickhouse 13. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:186: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93c36 in /usr/bin/clickhouse 14. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:69: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93121 in /usr/bin/clickhouse 15. /build/src/Interpreters/InDepthNodeVisitor.h:71: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000001cc92280 in /usr/bin/clickhouse 16. /build/src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc92461 in /usr/bin/clickhouse 17. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 18. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 19. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 20. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 21. /build/src/Interpreters/InDepthNodeVisitor.h:33: DB::InDepthNodeVisitor>::visit(std::shared_ptr&) @ 0x000000001cc91f65 in /usr/bin/clickhouse 22. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:321: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc957dd in /usr/bin/clickhouse 23. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93157 in /usr/bin/clickhouse 24. /build/src/Interpreters/InDepthNodeVisitor.h:71: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000001cc92280 in /usr/bin/clickhouse 25. /build/src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc92461 in /usr/bin/clickhouse 26. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 27. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 28. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 29. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 30. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 31. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 2024.10.21 19:13:07.558275 [ 791 ] {ec46268b-b62a-42d8-b1d1-d0bb07b63bfa} TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million: While processing (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery1: While processing 1 = ((SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery1). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x000000001b8a5e39 in /usr/bin/clickhouse 8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:234: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001ee9a1c3 in /usr/bin/clickhouse 9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1786: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001eea8aa6 in /usr/bin/clickhouse 10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee55d6c in /usr/bin/clickhouse 11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee7c2ff in /usr/bin/clickhouse 12. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x000000001cbd196b in /usr/bin/clickhouse 13. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:186: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93c36 in /usr/bin/clickhouse 14. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:69: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93121 in /usr/bin/clickhouse 15. /build/src/Interpreters/InDepthNodeVisitor.h:71: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000001cc92280 in /usr/bin/clickhouse 16. /build/src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc92461 in /usr/bin/clickhouse 17. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 18. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 19. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 20. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 21. /build/src/Interpreters/InDepthNodeVisitor.h:33: DB::InDepthNodeVisitor>::visit(std::shared_ptr&) @ 0x000000001cc91f65 in /usr/bin/clickhouse 22. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:321: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc957dd in /usr/bin/clickhouse 23. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93157 in /usr/bin/clickhouse 24. /build/src/Interpreters/InDepthNodeVisitor.h:71: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000001cc92280 in /usr/bin/clickhouse 25. /build/src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc92461 in /usr/bin/clickhouse 26. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 27. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 28. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 29. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 30. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 31. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 2024.10.21 19:13:07.993172 [ 791 ] {e2f2941a-b694-4ef2-8505-a2114e8466f3} executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44254) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x000000001b8a5e39 in /usr/bin/clickhouse 8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:234: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001ee9a1c3 in /usr/bin/clickhouse 9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1786: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001eea8aa6 in /usr/bin/clickhouse 10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee55d6c in /usr/bin/clickhouse 11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee7c2ff in /usr/bin/clickhouse 12. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x000000001cbd196b in /usr/bin/clickhouse 13. /build/src/Interpreters/executeQuery.cpp:1085: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001d0b4f37 in /usr/bin/clickhouse 14. /build/src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x000000001d0b0244 in /usr/bin/clickhouse 15. /build/src/Server/TCPHandler.cpp:496: DB::TCPHandler::runImpl() @ 0x000000001e64796d in /usr/bin/clickhouse 16. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 22. ? @ 0x00007f033e553ac3 in ? 23. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:13:07.995478 [ 791 ] {e2f2941a-b694-4ef2-8505-a2114e8466f3} TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x000000001b8a5e39 in /usr/bin/clickhouse 8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:234: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001ee9a1c3 in /usr/bin/clickhouse 9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1786: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001eea8aa6 in /usr/bin/clickhouse 10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee55d6c in /usr/bin/clickhouse 11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee7c2ff in /usr/bin/clickhouse 12. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x000000001cbd196b in /usr/bin/clickhouse 13. /build/src/Interpreters/executeQuery.cpp:1085: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001d0b4f37 in /usr/bin/clickhouse 14. /build/src/Interpreters/executeQuery.cpp:1224: DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x000000001d0b0244 in /usr/bin/clickhouse 15. /build/src/Server/TCPHandler.cpp:496: DB::TCPHandler::runImpl() @ 0x000000001e64796d in /usr/bin/clickhouse 16. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 22. ? @ 0x00007f033e553ac3 in ? 23. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:13:09.147857 [ 791 ] {8ecc43b8-64c4-40d0-957a-74a2bf6ebc08} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 17.76 million: While executing MergeTreeThread. (TOO_MANY_ROWS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44254) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) FROM test.hits WHERE NOT ignore(AdvEngineID);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 31. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 2024.10.21 19:13:09.178466 [ 791 ] {8ecc43b8-64c4-40d0-957a-74a2bf6ebc08} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 17.76 million: While executing MergeTreeThread. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 31. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 2024.10.21 19:13:09.641147 [ 791 ] {538d46f0-498c-4aff-8e9d-6527b7456375} executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million: While processing (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery4: While processing CounterID > ((SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery4). (TOO_MANY_ROWS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44254) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID > (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x000000001b8a5e39 in /usr/bin/clickhouse 8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:234: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001ee9a1c3 in /usr/bin/clickhouse 9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1786: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001eea8aa6 in /usr/bin/clickhouse 10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee55d6c in /usr/bin/clickhouse 11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee7c2ff in /usr/bin/clickhouse 12. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x000000001cbd196b in /usr/bin/clickhouse 13. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:186: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93c36 in /usr/bin/clickhouse 14. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:69: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93121 in /usr/bin/clickhouse 15. /build/src/Interpreters/InDepthNodeVisitor.h:71: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000001cc92280 in /usr/bin/clickhouse 16. /build/src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc92461 in /usr/bin/clickhouse 17. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 18. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 19. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 20. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 21. /build/src/Interpreters/InDepthNodeVisitor.h:33: DB::InDepthNodeVisitor>::visit(std::shared_ptr&) @ 0x000000001cc91f65 in /usr/bin/clickhouse 22. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:321: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc957dd in /usr/bin/clickhouse 23. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93157 in /usr/bin/clickhouse 24. /build/src/Interpreters/InDepthNodeVisitor.h:71: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000001cc92280 in /usr/bin/clickhouse 25. /build/src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc92461 in /usr/bin/clickhouse 26. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 27. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 28. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 29. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 30. /build/src/Interpreters/InDepthNodeVisitor.h:33: DB::InDepthNodeVisitor>::visit(std::shared_ptr&) @ 0x000000001cc91f65 in /usr/bin/clickhouse 31. /build/src/Interpreters/TreeRewriter.cpp:465: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr&, std::shared_ptr, unsigned long, std::map, std::allocator>>&, std::map, std::allocator>>&, bool, bool) @ 0x000000001cfa4688 in /usr/bin/clickhouse 2024.10.21 19:13:09.643192 [ 791 ] {538d46f0-498c-4aff-8e9d-6527b7456375} TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million: While processing (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery4: While processing CounterID > ((SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) AS _subquery4). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x000000001b8a5e39 in /usr/bin/clickhouse 8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:234: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001ee9a1c3 in /usr/bin/clickhouse 9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1786: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001eea8aa6 in /usr/bin/clickhouse 10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee55d6c in /usr/bin/clickhouse 11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001ee7c2ff in /usr/bin/clickhouse 12. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:379: DB::InterpreterSelectWithUnionQuery::execute() @ 0x000000001cbd196b in /usr/bin/clickhouse 13. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:186: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTSubquery const&, std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93c36 in /usr/bin/clickhouse 14. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:69: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93121 in /usr/bin/clickhouse 15. /build/src/Interpreters/InDepthNodeVisitor.h:71: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000001cc92280 in /usr/bin/clickhouse 16. /build/src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc92461 in /usr/bin/clickhouse 17. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 18. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 19. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 20. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 21. /build/src/Interpreters/InDepthNodeVisitor.h:33: DB::InDepthNodeVisitor>::visit(std::shared_ptr&) @ 0x000000001cc91f65 in /usr/bin/clickhouse 22. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:321: DB::ExecuteScalarSubqueriesMatcher::visit(DB::ASTFunction const&, std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc957dd in /usr/bin/clickhouse 23. /build/src/Interpreters/ExecuteScalarSubqueriesVisitor.cpp:71: DB::ExecuteScalarSubqueriesMatcher::visit(std::shared_ptr&, DB::ExecuteScalarSubqueriesMatcher::Data&) @ 0x000000001cc93157 in /usr/bin/clickhouse 24. /build/src/Interpreters/InDepthNodeVisitor.h:71: DB::InDepthNodeVisitor>::doVisit(std::shared_ptr&) @ 0x000000001cc92280 in /usr/bin/clickhouse 25. /build/src/Interpreters/InDepthNodeVisitor.h:61: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc92461 in /usr/bin/clickhouse 26. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 27. /build/src/Interpreters/InDepthNodeVisitor.h:83: void DB::InDepthNodeVisitor>::visitChildren(std::shared_ptr&) @ 0x000000001cc92506 in /usr/bin/clickhouse 28. /build/src/Interpreters/InDepthNodeVisitor.h:65: void DB::InDepthNodeVisitor>::visitImplMain(std::shared_ptr&) @ 0x000000001cc9246e in /usr/bin/clickhouse 29. /build/src/Interpreters/InDepthNodeVisitor.h:53: void DB::InDepthNodeVisitor>::visitImpl(std::shared_ptr&) @ 0x000000001cc9220a in /usr/bin/clickhouse 30. /build/src/Interpreters/InDepthNodeVisitor.h:33: DB::InDepthNodeVisitor>::visit(std::shared_ptr&) @ 0x000000001cc91f65 in /usr/bin/clickhouse 31. /build/src/Interpreters/TreeRewriter.cpp:465: DB::(anonymous namespace)::executeScalarSubqueries(std::shared_ptr&, std::shared_ptr, unsigned long, std::map, std::allocator>>&, std::map, std::allocator>>&, bool, bool) @ 0x000000001cfa4688 in /usr/bin/clickhouse 2024.10.21 19:13:10.085345 [ 791 ] {014c2c39-36d5-4345-9f0a-11d09441bc2e} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.12 million: While executing MergeTreeThread. (TOO_MANY_ROWS) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:44254) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID < (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 31. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 2024.10.21 19:13:10.102987 [ 791 ] {014c2c39-36d5-4345-9f0a-11d09441bc2e} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.12 million: While executing MergeTreeThread. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x000000001b8a5fc8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5aec in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 31. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 2024.10.21 19:33:07.287018 [ 791 ] {82fdf030-364a-4378-9c5c-aee6519b481a} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.188393945 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55010) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:07.603161 [ 2878 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:48036). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:07.603218 [ 791 ] {82fdf030-364a-4378-9c5c-aee6519b481a} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.188393945 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:11.662395 [ 791 ] {01ebd9b7-bae2-416e-a59f-be03eecae44a} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.383883735 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:55018) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:11.711153 [ 2905 ] {966b081e-097f-4745-aeba-effd8bab8fb5} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.087162744 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:45318) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:11.714483 [ 2878 ] {bc3b6e5c-3d72-40c1-9ccd-54cbcda0ff9b} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.14439484 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:47456) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:11.997278 [ 791 ] {01ebd9b7-bae2-416e-a59f-be03eecae44a} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.383883735 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:12.370035 [ 2905 ] {966b081e-097f-4745-aeba-effd8bab8fb5} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:45318). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x0000000013cf30a8 in /usr/bin/clickhouse 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x0000000013cf2424 in /usr/bin/clickhouse 7. /build/src/IO/WriteBuffer.h:48: DB::WriteBuffer::next() @ 0x000000000b207e8d in /usr/bin/clickhouse 8. /build/src/Server/TCPHandler.cpp:2073: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001e659e55 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2150: DB::TCPHandler::sendLogs() @ 0x000000001e6504ff in /usr/bin/clickhouse 10. /build/src/Server/TCPHandler.cpp:672: DB::TCPHandler::runImpl() @ 0x000000001e648af7 in /usr/bin/clickhouse 11. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 17. ? @ 0x00007f033e553ac3 in ? 18. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:12.370526 [ 2878 ] {bc3b6e5c-3d72-40c1-9ccd-54cbcda0ff9b} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:47456). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x0000000013cf30a8 in /usr/bin/clickhouse 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x0000000013cf2424 in /usr/bin/clickhouse 7. /build/src/IO/WriteBuffer.h:48: DB::WriteBuffer::next() @ 0x000000000b207e8d in /usr/bin/clickhouse 8. /build/src/Server/TCPHandler.cpp:2073: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001e659e55 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2150: DB::TCPHandler::sendLogs() @ 0x000000001e6504ff in /usr/bin/clickhouse 10. /build/src/Server/TCPHandler.cpp:672: DB::TCPHandler::runImpl() @ 0x000000001e648af7 in /usr/bin/clickhouse 11. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 17. ? @ 0x00007f033e553ac3 in ? 18. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:12.370636 [ 2905 ] {966b081e-097f-4745-aeba-effd8bab8fb5} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.087162744 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:12.371841 [ 2905 ] {966b081e-097f-4745-aeba-effd8bab8fb5} TCPHandler: Client has gone away. 2024.10.21 19:33:12.371919 [ 2878 ] {bc3b6e5c-3d72-40c1-9ccd-54cbcda0ff9b} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.14439484 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:12.374133 [ 2878 ] {bc3b6e5c-3d72-40c1-9ccd-54cbcda0ff9b} TCPHandler: Client has gone away. 2024.10.21 19:33:16.215270 [ 791 ] {01bedc3b-3201-4ee6-995d-1b8529f590cc} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.555250028 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46406) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:16.285594 [ 2906 ] {b0390820-b7b0-49bc-8946-8d36f3503829} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.238551019 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:45320) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:16.362822 [ 2878 ] {a8982168-359c-4a97-8df1-86b326c9a021} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.336148157 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:47468) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:16.375222 [ 2905 ] {55d68c2c-0a1d-4f5c-96bb-0ef7f1929e70} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.35374894 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43410) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:16.573047 [ 791 ] {01bedc3b-3201-4ee6-995d-1b8529f590cc} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.555250028 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:16.594136 [ 2906 ] {b0390820-b7b0-49bc-8946-8d36f3503829} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:45320). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x0000000013cf30a8 in /usr/bin/clickhouse 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x0000000013cf2424 in /usr/bin/clickhouse 7. /build/src/IO/WriteBuffer.h:48: DB::WriteBuffer::next() @ 0x000000000b207e8d in /usr/bin/clickhouse 8. /build/src/Server/TCPHandler.cpp:2073: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001e659e55 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2150: DB::TCPHandler::sendLogs() @ 0x000000001e6504ff in /usr/bin/clickhouse 10. /build/src/Server/TCPHandler.cpp:672: DB::TCPHandler::runImpl() @ 0x000000001e648af7 in /usr/bin/clickhouse 11. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 17. ? @ 0x00007f033e553ac3 in ? 18. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:16.595149 [ 2906 ] {b0390820-b7b0-49bc-8946-8d36f3503829} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.238551019 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:16.596679 [ 2906 ] {b0390820-b7b0-49bc-8946-8d36f3503829} TCPHandler: Client has gone away. 2024.10.21 19:33:16.609230 [ 2878 ] {a8982168-359c-4a97-8df1-86b326c9a021} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.336148157 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:16.610684 [ 2878 ] {a8982168-359c-4a97-8df1-86b326c9a021} TCPHandler: Client has gone away. 2024.10.21 19:33:16.639876 [ 2905 ] {55d68c2c-0a1d-4f5c-96bb-0ef7f1929e70} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:43410). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x0000000013cf30a8 in /usr/bin/clickhouse 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x0000000013cf2424 in /usr/bin/clickhouse 7. /build/src/IO/WriteBuffer.h:48: DB::WriteBuffer::next() @ 0x000000000b207e8d in /usr/bin/clickhouse 8. /build/src/Server/TCPHandler.cpp:2073: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001e659e55 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2150: DB::TCPHandler::sendLogs() @ 0x000000001e6504ff in /usr/bin/clickhouse 10. /build/src/Server/TCPHandler.cpp:672: DB::TCPHandler::runImpl() @ 0x000000001e648af7 in /usr/bin/clickhouse 11. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 17. ? @ 0x00007f033e553ac3 in ? 18. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:16.640721 [ 2905 ] {55d68c2c-0a1d-4f5c-96bb-0ef7f1929e70} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.35374894 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:16.641683 [ 2905 ] {55d68c2c-0a1d-4f5c-96bb-0ef7f1929e70} TCPHandler: Client has gone away. 2024.10.21 19:33:21.047366 [ 2878 ] {5068d7dd-eab1-4ac9-977b-f0a433d15266} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.075687551 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:52310) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:21.048549 [ 1804 ] {76043761-6264-415f-9084-767e933c527e} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.082622799 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:47480) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:21.051852 [ 2905 ] {d8f4a1da-f1b4-4d89-8ef8-63fb252ff148} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.079584266 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43412) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:21.505464 [ 791 ] {5d9539f3-4f72-4cd1-a81f-f3f05606c800} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.16000219 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:46416) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:21.505904 [ 1804 ] {76043761-6264-415f-9084-767e933c527e} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.082622799 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:21.505889 [ 2906 ] {d695fab3-4fd1-4be0-968b-16479609073a} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.134461803 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:45336) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:21.506501 [ 2878 ] {5068d7dd-eab1-4ac9-977b-f0a433d15266} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.075687551 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:21.506970 [ 2905 ] {d8f4a1da-f1b4-4d89-8ef8-63fb252ff148} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.079584266 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:21.544550 [ 2906 ] {d695fab3-4fd1-4be0-968b-16479609073a} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.134461803 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:21.557598 [ 2905 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:43412). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:21.558889 [ 2878 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52310). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:21.560453 [ 1804 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:47480). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:21.566157 [ 2906 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:45336). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:21.862738 [ 791 ] {5d9539f3-4f72-4cd1-a81f-f3f05606c800} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.16000219 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:26.123215 [ 2878 ] {484240a4-0595-496b-88fb-4a5d8b739e27} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.142703846 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:41460) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.176644 [ 2878 ] {484240a4-0595-496b-88fb-4a5d8b739e27} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.142703846 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.230096 [ 2905 ] {774daba4-726c-48e1-822c-6b12a0b1f801} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.405114164 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43680) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.486907 [ 2905 ] {774daba4-726c-48e1-822c-6b12a0b1f801} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.405114164 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.544608 [ 791 ] {238f2360-7f58-4b46-84a1-b2b1cf9138cd} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.018277372 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35596) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.575684 [ 2905 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:43680). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:26.601541 [ 2878 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:41460). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:26.617082 [ 1485 ] {3e3daf43-369a-42ce-9b6c-196b749407d2} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.747036767 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49996) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.625909 [ 1804 ] {7ed1ca01-f558-48eb-a84e-c74ac7739bda} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.6866993 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35506) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.656829 [ 2906 ] {c95c45ee-2c59-4c49-8dbd-e3811c7ca10b} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.748275863 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49568) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.932645 [ 791 ] {238f2360-7f58-4b46-84a1-b2b1cf9138cd} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.018277372 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.981164 [ 1804 ] {7ed1ca01-f558-48eb-a84e-c74ac7739bda} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.6866993 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:26.982676 [ 1804 ] {7ed1ca01-f558-48eb-a84e-c74ac7739bda} TCPHandler: Client has gone away. 2024.10.21 19:33:27.006206 [ 2906 ] {c95c45ee-2c59-4c49-8dbd-e3811c7ca10b} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.748275863 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:27.008318 [ 2906 ] {c95c45ee-2c59-4c49-8dbd-e3811c7ca10b} TCPHandler: Client has gone away. 2024.10.21 19:33:27.125847 [ 1485 ] {3e3daf43-369a-42ce-9b6c-196b749407d2} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.747036767 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:27.127559 [ 1485 ] {3e3daf43-369a-42ce-9b6c-196b749407d2} TCPHandler: Client has gone away. 2024.10.21 19:33:31.002427 [ 2878 ] {566121a3-1858-4674-b1e0-d51594a22d20} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.010776265 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:59278) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.046245 [ 2878 ] {566121a3-1858-4674-b1e0-d51594a22d20} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.010776265 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.061464 [ 1485 ] {b9f114b6-c12e-4e8d-b565-08cff983ed8a} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.020117533 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:43692) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.066533 [ 3290 ] {83f64b43-08e4-4bcc-9350-f45b68bd9c80} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.060238065 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35512) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.068943 [ 2905 ] {39bf05f4-6621-4fcc-ba08-63b3d0427ca0} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.096324985 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:50006) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.075686 [ 1485 ] {b9f114b6-c12e-4e8d-b565-08cff983ed8a} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.020117533 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.078066 [ 2906 ] {f0730b2e-b2b7-484f-801f-cb307c879857} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.085705507 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:41468) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.107703 [ 3290 ] {83f64b43-08e4-4bcc-9350-f45b68bd9c80} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.060238065 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.110599 [ 2905 ] {39bf05f4-6621-4fcc-ba08-63b3d0427ca0} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.096324985 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.113955 [ 1804 ] {1570d648-d3d3-40a3-8036-8fc62bedd1a4} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.121715692 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49582) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.125749 [ 1804 ] {1570d648-d3d3-40a3-8036-8fc62bedd1a4} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.121715692 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.129921 [ 791 ] {113aa465-9b17-4e77-b149-5a61980ca097} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.505332242 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:35600) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.158218 [ 1804 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:49582). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:31.160880 [ 3290 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:35512). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:31.162667 [ 2905 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:50006). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:31.381976 [ 2906 ] {f0730b2e-b2b7-484f-801f-cb307c879857} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:41468). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x0000000013cf30a8 in /usr/bin/clickhouse 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x0000000013cf2424 in /usr/bin/clickhouse 7. /build/src/IO/WriteBuffer.h:48: DB::WriteBuffer::next() @ 0x000000000b207e8d in /usr/bin/clickhouse 8. /build/src/Server/TCPHandler.cpp:2073: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001e659e55 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2150: DB::TCPHandler::sendLogs() @ 0x000000001e6504ff in /usr/bin/clickhouse 10. /build/src/Server/TCPHandler.cpp:672: DB::TCPHandler::runImpl() @ 0x000000001e648af7 in /usr/bin/clickhouse 11. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 17. ? @ 0x00007f033e553ac3 in ? 18. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:31.382817 [ 2906 ] {f0730b2e-b2b7-484f-801f-cb307c879857} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.085705507 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:31.384165 [ 2906 ] {f0730b2e-b2b7-484f-801f-cb307c879857} TCPHandler: Client has gone away. 2024.10.21 19:33:31.449834 [ 791 ] {113aa465-9b17-4e77-b149-5a61980ca097} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.505332242 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.535206 [ 3290 ] {87ce9bcd-3c32-4c0d-9218-70064d1d509b} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.210233726 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:56944) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.592361 [ 3290 ] {87ce9bcd-3c32-4c0d-9218-70064d1d509b} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.210233726 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.622494 [ 791 ] {5456efb3-62c7-4676-90a1-962b1991352f} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.285531079 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:44732) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.779480 [ 2906 ] {e82f4e27-9ece-4dfb-954c-86897cccbba9} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.341749373 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:56890) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.812156 [ 2906 ] {e82f4e27-9ece-4dfb-954c-86897cccbba9} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.341749373 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.831177 [ 791 ] {5456efb3-62c7-4676-90a1-962b1991352f} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.285531079 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.944926 [ 2878 ] {ceada0f4-c3c5-4521-a99d-6983222370df} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.607916884 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:42112) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.945111 [ 2905 ] {11c20d15-16bf-4bf4-9883-13c19bd8a3ea} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.617643305 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:46598) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.951361 [ 3292 ] {e05972a0-bae8-4398-bd7d-d05c7d3221fd} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.611021212 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60388) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:35.962250 [ 1485 ] {dab7fb41-0bef-44a2-aea7-dc90ade9848d} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.620141695 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:57088) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:36.015745 [ 2878 ] {ceada0f4-c3c5-4521-a99d-6983222370df} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.607916884 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:36.056155 [ 1804 ] {21764ed5-4f4a-45a0-bc99-9ca939066986} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.008001902 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37802) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:36.078292 [ 3292 ] {e05972a0-bae8-4398-bd7d-d05c7d3221fd} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.611021212 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:36.081474 [ 3292 ] {e05972a0-bae8-4398-bd7d-d05c7d3221fd} TCPHandler: Client has gone away. 2024.10.21 19:33:36.082712 [ 2878 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:42112). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:36.089470 [ 791 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:44732). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:36.093466 [ 2906 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:56890). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:36.214300 [ 2905 ] {11c20d15-16bf-4bf4-9883-13c19bd8a3ea} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.617643305 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:36.216121 [ 2905 ] {11c20d15-16bf-4bf4-9883-13c19bd8a3ea} TCPHandler: Client has gone away. 2024.10.21 19:33:36.267249 [ 1485 ] {dab7fb41-0bef-44a2-aea7-dc90ade9848d} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.620141695 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:36.268934 [ 1485 ] {dab7fb41-0bef-44a2-aea7-dc90ade9848d} TCPHandler: Client has gone away. 2024.10.21 19:33:36.353840 [ 1804 ] {21764ed5-4f4a-45a0-bc99-9ca939066986} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.008001902 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:39.025277 [ 2874 ] {0ead1a22-18c4-4d1c-8e63-c58a4b37a0db} executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.47 MiB: While executing MergeTreeInOrder. (TOO_MANY_BYTES) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50058) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001b8a61e8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5cc7 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:389: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001e6d4db1 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:110: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d43b6 in /usr/bin/clickhouse 14. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 26. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 27. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 31. ? @ 0x00007f033e553ac3 in ? 2024.10.21 19:33:39.031420 [ 2874 ] {0ead1a22-18c4-4d1c-8e63-c58a4b37a0db} TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.47 MiB: While executing MergeTreeInOrder. (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001b8a61e8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5cc7 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:389: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001e6d4db1 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:110: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d43b6 in /usr/bin/clickhouse 14. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 26. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 27. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 31. ? @ 0x00007f033e553ac3 in ? 2024.10.21 19:33:40.583862 [ 2905 ] {497314c7-1521-4d17-8d3e-a2768f1c7738} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.30420567 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:56896) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.608312 [ 3290 ] {a85f4ff6-6e87-46ad-b430-bee15f3d50b3} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.254324271 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:57104) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.616999 [ 2905 ] {497314c7-1521-4d17-8d3e-a2768f1c7738} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.30420567 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.618206 [ 3292 ] {1da654b5-4dbc-4617-8a9f-77ca9f463748} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.335150966 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60396) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.660027 [ 3290 ] {a85f4ff6-6e87-46ad-b430-bee15f3d50b3} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.254324271 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.674219 [ 3292 ] {1da654b5-4dbc-4617-8a9f-77ca9f463748} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.335150966 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.732536 [ 2878 ] {5d27a882-b676-4939-a2f0-ba61e137a701} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.447787068 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49658) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.739941 [ 791 ] {7c9006a8-7ff0-41f0-b8a0-2333a24892b0} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.417155961 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:42114) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.766281 [ 2878 ] {5d27a882-b676-4939-a2f0-ba61e137a701} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.447787068 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.863260 [ 1804 ] {4f8fd2fc-5806-475a-b3be-1f1dca6a3555} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.924789109 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:37804) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.885888 [ 791 ] {7c9006a8-7ff0-41f0-b8a0-2333a24892b0} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.417155961 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.907027 [ 2906 ] {21221667-9627-4519-ab69-9e21a011f411} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.659073556 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:44736) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.910564 [ 1485 ] {4ce917e1-1f91-4b66-bf74-b87b6ddde96e} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.639935336 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:46612) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:40.911946 [ 791 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:42114). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:40.932062 [ 2905 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:56896). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:40.955553 [ 3294 ] {5b2b6eca-dc17-47b9-b905-0669c8e7a5aa} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.675865961 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:56946) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:41.243275 [ 1485 ] {4ce917e1-1f91-4b66-bf74-b87b6ddde96e} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.639935336 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:41.251004 [ 1485 ] {4ce917e1-1f91-4b66-bf74-b87b6ddde96e} TCPHandler: Client has gone away. 2024.10.21 19:33:41.269550 [ 2906 ] {21221667-9627-4519-ab69-9e21a011f411} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.659073556 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:41.270905 [ 2906 ] {21221667-9627-4519-ab69-9e21a011f411} TCPHandler: Client has gone away. 2024.10.21 19:33:41.324082 [ 1804 ] {4f8fd2fc-5806-475a-b3be-1f1dca6a3555} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.924789109 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:41.386665 [ 3294 ] {5b2b6eca-dc17-47b9-b905-0669c8e7a5aa} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.675865961 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:41.387976 [ 3294 ] {5b2b6eca-dc17-47b9-b905-0669c8e7a5aa} TCPHandler: Client has gone away. 2024.10.21 19:33:46.205665 [ 3296 ] {25b30911-d707-434f-b142-84197be2eac2} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.365190982 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:52776) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.286615 [ 2906 ] {7c347dd1-2523-4f8a-ae84-4c1e9714463a} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.537104912 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:42094) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.312474 [ 1485 ] {bd6f396e-8aeb-463c-936d-b7506f681d02} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.204002273 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:36944) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:46.477053 [ 3296 ] {25b30911-d707-434f-b142-84197be2eac2} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.365190982 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.517603 [ 1485 ] {bd6f396e-8aeb-463c-936d-b7506f681d02} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.204002273 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:46.575678 [ 2906 ] {7c347dd1-2523-4f8a-ae84-4c1e9714463a} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.537104912 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.665885 [ 3290 ] {529b9308-44fe-4200-86bb-d90d0a8d8686} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.816216605 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:56608) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.684173 [ 3290 ] {529b9308-44fe-4200-86bb-d90d0a8d8686} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.816216605 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:102: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4316 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007f033e553ac3 in ? 29. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.696908 [ 791 ] {7dae3c87-23f5-4622-956d-278589353115} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.276106949 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60146) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.764587 [ 1804 ] {37673951-dae4-4a6d-85de-2d5853b5dafa} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.096002069 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:57772) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:46.765034 [ 2905 ] {fd82d690-05e0-4d46-9455-b529065a2559} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.068002016 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:59558) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:46.769868 [ 3292 ] {a472d362-d028-4bf5-88f8-16b6de3afa2f} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.988274145 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:39880) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.777468 [ 2878 ] {59d023e1-609d-4f6d-8e8e-89a79dd8072f} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.979850009 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:36890) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.778117 [ 3294 ] {bbbaf8e3-7a4b-41ff-87c2-51d32871f63a} executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.01192671 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 23.8.16.42.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40536) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` GROUP BY `k` ORDER BY `c` DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.785325 [ 3290 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:56608). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:46.787959 [ 3296 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52776). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::TCPHandler::runImpl() @ 0x000000001e6467c1 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 15. ? @ 0x00007f033e553ac3 in ? 16. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:46.878896 [ 2878 ] {59d023e1-609d-4f6d-8e8e-89a79dd8072f} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:36890). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x0000000013cf30a8 in /usr/bin/clickhouse 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:96: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x0000000013cf2424 in /usr/bin/clickhouse 7. /build/src/IO/WriteBuffer.h:48: DB::WriteBuffer::next() @ 0x000000000b207e8d in /usr/bin/clickhouse 8. /build/src/Server/TCPHandler.cpp:2073: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001e659e55 in /usr/bin/clickhouse 9. /build/src/Server/TCPHandler.cpp:2150: DB::TCPHandler::sendLogs() @ 0x000000001e6504ff in /usr/bin/clickhouse 10. /build/src/Server/TCPHandler.cpp:672: DB::TCPHandler::runImpl() @ 0x000000001e648af7 in /usr/bin/clickhouse 11. /build/src/Server/TCPHandler.cpp:2159: DB::TCPHandler::run() @ 0x000000001e659f85 in /usr/bin/clickhouse 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000247837b9 in /usr/bin/clickhouse 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000024783ffc in /usr/bin/clickhouse 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x00000000249d8674 in /usr/bin/clickhouse 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x00000000249d541a in /usr/bin/clickhouse 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000249d411e in /usr/bin/clickhouse 17. ? @ 0x00007f033e553ac3 in ? 18. ? @ 0x00007f033e5e4a04 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.21 19:33:46.881219 [ 2878 ] {59d023e1-609d-4f6d-8e8e-89a79dd8072f} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.979850009 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.883243 [ 2878 ] {59d023e1-609d-4f6d-8e8e-89a79dd8072f} TCPHandler: Client has gone away. 2024.10.21 19:33:46.915801 [ 3294 ] {bbbaf8e3-7a4b-41ff-87c2-51d32871f63a} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.01192671 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.937271 [ 791 ] {7dae3c87-23f5-4622-956d-278589353115} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.276106949 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:46.939499 [ 3294 ] {bbbaf8e3-7a4b-41ff-87c2-51d32871f63a} TCPHandler: Client has gone away. 2024.10.21 19:33:46.968572 [ 791 ] {7dae3c87-23f5-4622-956d-278589353115} TCPHandler: Client has gone away. 2024.10.21 19:33:46.978518 [ 2905 ] {fd82d690-05e0-4d46-9455-b529065a2559} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.068002016 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:46.980654 [ 2905 ] {fd82d690-05e0-4d46-9455-b529065a2559} TCPHandler: Client has gone away. 2024.10.21 19:33:47.079042 [ 1804 ] {37673951-dae4-4a6d-85de-2d5853b5dafa} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.096002069 seconds, maximum: 1: While executing MergeTreeThread. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87bf31 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001e6d6c98 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bf5 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call(DB::PipelineExecutor::spawnThreads()::$_0&) @ 0x000000001e6d6bd5 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::operator()[abi:v15000]() @ 0x000000001e6d6bb5 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x000000001e6d6b80 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 20. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x0000000013a5ff63 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a6a7c4 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&>(void&&) @ 0x0000000013a6a795 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000013a6a779 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x0000000013a6a6dd in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x0000000013a6a5e5 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) @ 0x0000000013a6a555 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()&) @ 0x0000000013a6a535 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x0000000013a6a515 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013a6a4e0 in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 2024.10.21 19:33:47.084094 [ 3292 ] {a472d362-d028-4bf5-88f8-16b6de3afa2f} TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.988274145 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87ea2c in /usr/bin/clickhouse 6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:110: bool DB::handleOverflowMode(DB::OverflowMode, int, FormatStringHelperImpl::type, std::type_identity::type>, double&&, double&&) @ 0x000000001b87de73 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:126: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x000000001b87dd88 in /usr/bin/clickhouse 8. /build/src/Interpreters/ProcessList.cpp:465: DB::QueryStatus::checkTimeLimit() @ 0x000000001ccae359 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/PipelineExecutor.cpp:185: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001e6d4ca0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:195: DB::PipelineExecutor::finalizeExecution() @ 0x000000001e6d537c in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:130: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d4c16 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 17. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 25. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 29. ? @ 0x00007f033e553ac3 in ? 30. ? @ 0x00007f033e5e4a04 in ? 2024.10.21 19:33:47.085717 [ 3292 ] {a472d362-d028-4bf5-88f8-16b6de3afa2f} TCPHandler: Client has gone away. 2024.10.21 19:34:12.215286 [ 2874 ] {66320be2-222d-4f99-8d43-552106e5edb2} executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.47 MiB: While executing MergeTreeInOrder. (TOO_MANY_BYTES) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50058) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001b8a61e8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5cc7 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:389: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001e6d4db1 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:110: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d43b6 in /usr/bin/clickhouse 14. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 26. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 27. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 31. ? @ 0x00007f033e553ac3 in ? 2024.10.21 19:34:12.257818 [ 2874 ] {66320be2-222d-4f99-8d43-552106e5edb2} TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.47 MiB: While executing MergeTreeInOrder. (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001b8a61e8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5cc7 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:389: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001e6d4db1 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:110: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d43b6 in /usr/bin/clickhouse 14. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 26. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 27. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 31. ? @ 0x00007f033e553ac3 in ? 2024.10.21 19:35:03.800137 [ 2874 ] {4434ecf9-558b-42ed-8f42-a822865dd76d} executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.47 MiB: While executing MergeTreeInOrder. (TOO_MANY_BYTES) (version 23.8.16.42.altinitystable (altinity build)) (from [::1]:50058) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits PREWHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001b8a61e8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5cc7 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:389: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001e6d4db1 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:110: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d43b6 in /usr/bin/clickhouse 14. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 26. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 27. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 31. ? @ 0x00007f033e553ac3 in ? 2024.10.21 19:35:03.809316 [ 2874 ] {4434ecf9-558b-42ed-8f42-a822865dd76d} TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.47 MiB: While executing MergeTreeInOrder. (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/Exception.h:101: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001b8a61e8 in /usr/bin/clickhouse 6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x000000001b8a5cc7 in /usr/bin/clickhouse 7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x000000001b87c2a4 in /usr/bin/clickhouse 8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001e6f10f1 in /usr/bin/clickhouse 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001e6f0ba0 in /usr/bin/clickhouse 10. /build/src/Processors/Executors/PipelineExecutor.cpp:251: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001e6d5bc1 in /usr/bin/clickhouse 11. /build/src/Processors/Executors/PipelineExecutor.cpp:217: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001e6d5f57 in /usr/bin/clickhouse 12. /build/src/Processors/Executors/PipelineExecutor.cpp:389: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001e6d4db1 in /usr/bin/clickhouse 13. /build/src/Processors/Executors/PipelineExecutor.cpp:110: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001e6d43b6 in /usr/bin/clickhouse 14. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:84: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001e6f7c66 in /usr/bin/clickhouse 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:113: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001e6f7aff in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000](DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) @ 0x000000001e6f7a75 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e6f7a59 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001e6f79bd in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001e6f78c7 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001e6f7835 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) @ 0x000000001e6f7815 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001e6f77f5 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001e6f77c0 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 26. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 27. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 31. ? @ 0x00007f033e553ac3 in ? 2024.10.21 19:57:33.128259 [ 785 ] {} Application: Closed all listening sockets. Waiting for 3 outstanding connections. 2024.10.21 19:57:38.066030 [ 785 ] {} Application: Closed connections. But 3 remain. Tip: To increase wait time add to config: 60 2024.10.21 19:57:38.066500 [ 785 ] {} Application: Will shutdown forcefully.