2024.11.04 22:37:12.542003 [ 391 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2024.11.04 22:37:12.573838 [ 391 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2024.11.04 22:37:12.576505 [ 391 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2024.11.04 22:37:16.189679 [ 391 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2024.11.04 22:37:16.574060 [ 391 ] {} <Warning> KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper.
2024.11.04 22:37:16.575134 [ 391 ] {} <Warning> KeeperLogStore: Removing all changelogs
2024.11.04 22:37:16.576597 [ 391 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2024.11.04 22:37:16.582321 [ 391 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2024.11.04 22:37:16.582447 [ 391 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2024.11.04 22:37:16.633779 [ 1007 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2024.11.04 22:37:16.735675 [ 391 ] {} <Warning> Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist
2024.11.04 22:37:16.735802 [ 391 ] {} <Warning> Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/
2024.11.04 22:37:17.314969 [ 391 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2024.11.04 22:37:20.542288 [ 394 ] {958d5d20-8fe5-47e4-b9c0-4a77169c3cb6} <Warning> InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE hits_v1; to attach existing table or CREATE TABLE hits_v1 <table definition>; to create new table or ATTACH TABLE hits_v1 FROM '/path/to/data/' <table definition>; to create new table and attach data.
2024.11.04 22:37:29.443066 [ 394 ] {0869f455-f81f-488b-94fc-93cd4b92d9e7} <Warning> InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE visits_v1; to attach existing table or CREATE TABLE visits_v1 <table definition>; to create new table or ATTACH TABLE visits_v1 FROM '/path/to/data/' <table definition>; to create new table and attach data.
2024.11.04 22:43:11.536929 [ 394 ] {c4411eaf-e579-4e37-9682-b362d9262fe5} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:49396) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 = (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec2799
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd51063
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd62d9e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd09490
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd33f1f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508f41
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b508c9b
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0c0108
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a310d
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a1221
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b81f8
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a2cea
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a1221
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab9c7
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09d543
22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b09b774
23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b09b433
24. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08cba6
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b5085ac
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5071e6
27. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b50a5b7
28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b509a4c
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5099fd
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50999d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50995d

2024.11.04 22:43:11.537743 [ 394 ] {c4411eaf-e579-4e37-9682-b362d9262fe5} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec2799
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd51063
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd62d9e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd09490
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd33f1f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508f41
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b508c9b
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0c0108
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a310d
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a1221
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b81f8
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a2cea
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a1221
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab9c7
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09d543
22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b09b774
23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b09b433
24. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08cba6
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b5085ac
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5071e6
27. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b50a5b7
28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b509a4c
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5099fd
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50999d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50995d

2024.11.04 22:43:11.712576 [ 394 ] {10e9c119-0b0c-4bc2-9e81-5eb5d25a3c43} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:49396) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec2799
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd51063
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd62d9e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd09490
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd33f1f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508f41
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b508c9b
14. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2ed7
15. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbacfaa
16. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d470660
17. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
18. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
19. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
20. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
21. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
22. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
23. ? @ 0x00007fc03cc8fac3
24. ? @ 0x00007fc03cd21850

2024.11.04 22:43:11.713421 [ 394 ] {10e9c119-0b0c-4bc2-9e81-5eb5d25a3c43} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec2799
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd51063
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd62d9e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd09490
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd33f1f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508f41
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b508c9b
14. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2ed7
15. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbacfaa
16. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d470660
17. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
18. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
19. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
20. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
21. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
22. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
23. ? @ 0x00007fc03cc8fac3
24. ? @ 0x00007fc03cd21850

2024.11.04 22:43:12.945569 [ 394 ] {f08ca191-ec42-4cd1-b5d0-e8cfdb5df4a8} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 18.02 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:49396) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) FROM test.hits WHERE NOT ignore(AdvEngineID);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:43:13.014469 [ 394 ] {f08ca191-ec42-4cd1-b5d0-e8cfdb5df4a8} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 18.02 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:43:13.262131 [ 394 ] {dfc84c52-1d10-4672-9131-518cabe24a5a} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:49396) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID > (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec2799
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd51063
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd62d9e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd09490
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd33f1f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508f41
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b508c9b
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0c0108
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a310d
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a1221
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b81f8
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a2cea
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8198: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09d877
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b09b774
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b09b433
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08cba6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b5085ac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5071e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b50a5b7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b509a4c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5099fd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50999d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50995d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509925
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42931e

2024.11.04 22:43:13.263194 [ 394 ] {dfc84c52-1d10-4672-9131-518cabe24a5a} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec2799
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd51063
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd62d9e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd09490
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd33f1f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508f41
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b508c9b
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0c0108
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a310d
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a1221
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b81f8
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a2cea
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8198: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09d877
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b09b774
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b09b433
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08cba6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b5085ac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5071e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b50a5b7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b509a4c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5099fd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50999d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50995d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509925
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42931e

2024.11.04 22:43:13.537393 [ 394 ] {d8eedeed-4cb2-49a2-9683-618c8142dbc9} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.12 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:49396) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID < (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:43:13.558325 [ 394 ] {d8eedeed-4cb2-49a2-9683-618c8142dbc9} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.12 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec2928
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec244c
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:57:49.925463 [ 2946 ] {3d2a80ab-47e6-4bf2-bf7e-51c696aff71e} <Error> executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 586.09 MiB: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_BYTES) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:40104) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000019ec2b48
6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec2627
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:57:49.972530 [ 2946 ] {3d2a80ab-47e6-4bf2-bf7e-51c696aff71e} <Error> TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 586.09 MiB: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000019ec2b48
6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec2627
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:57:51.556058 [ 2946 ] {1528fb78-f446-4a85-a06f-687420820dd8} <Error> executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 579.43 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:40104) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000019ec2b48
6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec2627
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:57:51.689808 [ 2946 ] {1528fb78-f446-4a85-a06f-687420820dd8} <Error> TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 579.43 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000019ec2b48
6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec2627
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:57:52.215002 [ 2946 ] {96eeb06c-3d34-4ef3-a047-b6fece8a1f21} <Error> executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 587.61 MiB: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_BYTES) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:40104) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits PREWHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000019ec2b48
6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec2627
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:57:52.264405 [ 2946 ] {96eeb06c-3d34-4ef3-a047-b6fece8a1f21} <Error> TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 587.61 MiB: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, ReadableSize, ReadableSize>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<ReadableSize>::type, std::type_identity<ReadableSize>::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000019ec2b48
6. /build/src/QueryPipeline/SizeLimits.cpp:36: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec2627
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94884
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1

2024.11.04 22:58:00.339354 [ 2948 ] {a66abb82-60a1-4d8a-9273-f763ef363756} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.160126063 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:49794) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:00.364424 [ 1989 ] {e3b61f68-eb17-40a6-9ed2-ebc5089a0045} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.33156672 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:58254) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:00.364527 [ 2948 ] {a66abb82-60a1-4d8a-9273-f763ef363756} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.160126063 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:00.379872 [ 1990 ] {2e4e181c-333d-4921-a828-e1b2095c9753} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.344784641 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:39170) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:01.006075 [ 1989 ] {e3b61f68-eb17-40a6-9ed2-ebc5089a0045} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.33156672 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:01.012998 [ 1989 ] {e3b61f68-eb17-40a6-9ed2-ebc5089a0045} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:01.214557 [ 1990 ] {2e4e181c-333d-4921-a828-e1b2095c9753} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.344784641 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:01.215239 [ 1990 ] {2e4e181c-333d-4921-a828-e1b2095c9753} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:05.515990 [ 1990 ] {1b6f35fa-e57f-4eef-beaa-842d2c1e7b34} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.574858875 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:56816) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:05.518030 [ 1989 ] {f13b0ae3-cbdc-4116-aad3-25104d6bc9de} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.573009301 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:34020) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:06.113628 [ 1990 ] {1b6f35fa-e57f-4eef-beaa-842d2c1e7b34} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.574858875 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:06.200547 [ 1989 ] {f13b0ae3-cbdc-4116-aad3-25104d6bc9de} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.573009301 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:06.536478 [ 2948 ] {13c9ed7a-0355-464e-a837-7660a7cdcaa5} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.821139967 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:37150) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:06.643986 [ 2362 ] {6d48a379-b307-45f0-a8ce-3449a47065e9} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.60086134 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49400) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:06.723453 [ 1989 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:34020). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:06.723525 [ 2948 ] {13c9ed7a-0355-464e-a837-7660a7cdcaa5} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.821139967 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:06.742880 [ 2362 ] {6d48a379-b307-45f0-a8ce-3449a47065e9} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.60086134 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:06.743742 [ 2362 ] {6d48a379-b307-45f0-a8ce-3449a47065e9} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:11.780847 [ 1990 ] {94e84d4f-342d-4df7-926e-5bf87e3fb0ce} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.797519337 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:56832) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:11.799750 [ 2946 ] {202c406e-6f71-4968-a3e8-f82b6c2d95a0} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.813051749 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:37606) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:11.804920 [ 2945 ] {c283efc2-cc7a-4a8f-99d4-b3ea339a10df} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.820769038 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:34032) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:12.222407 [ 2945 ] {c283efc2-cc7a-4a8f-99d4-b3ea339a10df} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.820769038 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:12.224609 [ 1990 ] {94e84d4f-342d-4df7-926e-5bf87e3fb0ce} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.797519337 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:12.226062 [ 2946 ] {202c406e-6f71-4968-a3e8-f82b6c2d95a0} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.813051749 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:12.618608 [ 2362 ] {9cf2c8e8-03cd-4663-a1d1-936e853026c0} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.63231132 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49416) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:12.622877 [ 1989 ] {6c5e3632-a148-44ac-8c50-bbbdb66838af} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.809000332 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:37154) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:12.711470 [ 2362 ] {9cf2c8e8-03cd-4663-a1d1-936e853026c0} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.63231132 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:12.714672 [ 2362 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:49416). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:12.716335 [ 2945 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:34032). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:12.716568 [ 1989 ] {6c5e3632-a148-44ac-8c50-bbbdb66838af} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.809000332 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:17.387378 [ 2946 ] {2f31dbac-8ddc-4ea5-b43e-c7e0c4e9fde1} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.372044938 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:45200) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:17.434070 [ 2947 ] {817a1110-9ffe-40fd-b102-263442eca2ce} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.41615154 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:39822) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:17.755033 [ 2946 ] {2f31dbac-8ddc-4ea5-b43e-c7e0c4e9fde1} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.372044938 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:17.789968 [ 2947 ] {817a1110-9ffe-40fd-b102-263442eca2ce} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.41615154 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:18.233426 [ 2948 ] {6859b627-03ae-4c64-a4c3-c1a2bdca6c55} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.221463225 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40168) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:18.304892 [ 2948 ] {6859b627-03ae-4c64-a4c3-c1a2bdca6c55} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.221463225 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:18.331804 [ 2945 ] {10a1aa31-2677-4440-8a02-103452fb2ac5} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.314607231 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:36986) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:18.351262 [ 1990 ] {9eec3a8a-3a05-455e-adca-9dd18422e68f} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.519528238 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:53896) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:18.353115 [ 2362 ] {9c9990d8-6ec2-47ca-ba76-aefed93754f5} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.29983676 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35216) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:18.379963 [ 2948 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:40168). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:18.380770 [ 1990 ] {9eec3a8a-3a05-455e-adca-9dd18422e68f} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.519528238 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:18.430155 [ 2362 ] {9c9990d8-6ec2-47ca-ba76-aefed93754f5} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.29983676 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:18.430831 [ 2362 ] {9c9990d8-6ec2-47ca-ba76-aefed93754f5} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:18.431611 [ 2945 ] {10a1aa31-2677-4440-8a02-103452fb2ac5} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.314607231 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:18.432243 [ 2945 ] {10a1aa31-2677-4440-8a02-103452fb2ac5} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:24.613220 [ 2947 ] {10d71378-9262-4678-9c43-e67f0dcf320a} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.963573282 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:45202) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:24.619034 [ 1990 ] {0d8bd121-c089-42d7-bc6c-367a3e15e832} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.970748846 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40174) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:24.623041 [ 2362 ] {5de13dbb-015c-4b44-86f8-26681c22908f} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.975401326 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35220) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:24.643082 [ 2946 ] {e37f884d-39e9-47ee-9a6d-869b399ae410} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.950317119 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40462) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:24.647381 [ 2945 ] {1361b526-10bc-409f-bd49-bbba23a1cb14} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.98500053 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:39836) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.149862 [ 2362 ] {5de13dbb-015c-4b44-86f8-26681c22908f} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.975401326 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.166375 [ 1990 ] {0d8bd121-c089-42d7-bc6c-367a3e15e832} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.970748846 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.220683 [ 2946 ] {e37f884d-39e9-47ee-9a6d-869b399ae410} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.950317119 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.222301 [ 2947 ] {10d71378-9262-4678-9c43-e67f0dcf320a} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.963573282 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.233533 [ 2945 ] {1361b526-10bc-409f-bd49-bbba23a1cb14} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.98500053 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.558786 [ 3373 ] {acbd8f6f-060d-40e4-88a9-df9c9923349f} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.907667724 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:36994) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.571304 [ 1989 ] {847ee021-ed46-42ca-ba34-56fec6430c09} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.120955847 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:53904) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.595155 [ 2947 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:45202). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:25.596973 [ 2945 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:39836). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:25.597632 [ 2362 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:35220). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:25.598131 [ 1990 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:40174). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:25.598159 [ 1989 ] {847ee021-ed46-42ca-ba34-56fec6430c09} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.120955847 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.662056 [ 3373 ] {acbd8f6f-060d-40e4-88a9-df9c9923349f} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.907667724 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:25.663236 [ 3373 ] {acbd8f6f-060d-40e4-88a9-df9c9923349f} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:31.853947 [ 3383 ] {b703e97f-6f40-4f65-b3e9-22f24fec41ed} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.989055401 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:56256) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:31.862707 [ 2947 ] {29b74ee1-d023-4ff5-8f28-551a18587e3f} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.996449369 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35646) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:31.872033 [ 1990 ] {0f3ad437-e737-40da-9846-fb30362c134c} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.008279618 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35376) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:31.874762 [ 3373 ] {72bffe88-3329-4fb6-b6a0-515cf45b4e01} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.012604268 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60092) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:31.896848 [ 2362 ] {dc067f1a-3f68-49c5-bed2-368fe5f3c7e4} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.030510063 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49388) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.365578 [ 1990 ] {0f3ad437-e737-40da-9846-fb30362c134c} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.008279618 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.443386 [ 3373 ] {72bffe88-3329-4fb6-b6a0-515cf45b4e01} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.012604268 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.444791 [ 3383 ] {b703e97f-6f40-4f65-b3e9-22f24fec41ed} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.989055401 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.480896 [ 2362 ] {dc067f1a-3f68-49c5-bed2-368fe5f3c7e4} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.030510063 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.490226 [ 2947 ] {29b74ee1-d023-4ff5-8f28-551a18587e3f} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.996449369 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.836066 [ 2945 ] {c44d1154-c3c8-44da-860c-b7dcf14b5ddc} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.969652311 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:35232) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.887274 [ 2946 ] {ed20bbe8-5548-49f8-b99d-85b74891de86} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.018972633 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49542) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.897341 [ 2948 ] {1993b9cf-708d-474d-b936-0f902d9def9c} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.190303154 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:44316) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.923779 [ 1990 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:35376). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:32.924430 [ 2948 ] {1993b9cf-708d-474d-b936-0f902d9def9c} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.190303154 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.925931 [ 2945 ] {c44d1154-c3c8-44da-860c-b7dcf14b5ddc} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.969652311 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.926742 [ 2945 ] {c44d1154-c3c8-44da-860c-b7dcf14b5ddc} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:32.987839 [ 2946 ] {ed20bbe8-5548-49f8-b99d-85b74891de86} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.018972633 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:32.988571 [ 2946 ] {ed20bbe8-5548-49f8-b99d-85b74891de86} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:38.904790 [ 2362 ] {df12f04f-4bd0-4139-83d1-cc8a6c9706a5} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.116015204 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:44884) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:39.264033 [ 2362 ] {df12f04f-4bd0-4139-83d1-cc8a6c9706a5} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.116015204 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:39.445831 [ 2945 ] {5b138df2-023b-4bc4-997c-d430efeb2115} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.284698483 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:52128) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:39.497404 [ 3373 ] {fc19abd8-c98a-408c-aedb-b0373911ab49} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.128015368 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:58104) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:39.497905 [ 3383 ] {26a14d79-a028-4828-b54b-3c2af93b8442} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.323516593 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:44506) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:39.498417 [ 1989 ] {9769ac3a-269d-42a3-9ccf-97ace2ffd2ec} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.33233947 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:46088) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:39.518346 [ 3396 ] {1c15cc15-e2da-49bb-9ed1-1dc1f90f12b8} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.012013787 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:59350) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:39.535597 [ 2946 ] {6a5bf16c-9d3f-496d-9b1d-a9605ac2a6a5} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.374274983 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33586) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:39.908448 [ 3383 ] {26a14d79-a028-4828-b54b-3c2af93b8442} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.323516593 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:40.217616 [ 2945 ] {5b138df2-023b-4bc4-997c-d430efeb2115} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.284698483 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:40.320273 [ 1990 ] {fcfea63c-0df3-473b-a79c-1e5587c62752} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.35426448 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:40442) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:40.360221 [ 2947 ] {a264fc83-4fa1-4a9b-82ef-819f0763b14b} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.183958012 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60126) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:40.364243 [ 2946 ] {6a5bf16c-9d3f-496d-9b1d-a9605ac2a6a5} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.374274983 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:40.369671 [ 1989 ] {9769ac3a-269d-42a3-9ccf-97ace2ffd2ec} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.33233947 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:40.388030 [ 3396 ] {1c15cc15-e2da-49bb-9ed1-1dc1f90f12b8} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.012013787 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:40.397762 [ 3396 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:59350). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:40.399810 [ 1989 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:46088). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:40.405315 [ 2946 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:33586). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:40.409662 [ 3373 ] {fc19abd8-c98a-408c-aedb-b0373911ab49} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.128015368 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:40.410404 [ 3373 ] {fc19abd8-c98a-408c-aedb-b0373911ab49} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:40.415938 [ 1990 ] {fcfea63c-0df3-473b-a79c-1e5587c62752} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.35426448 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:40.474361 [ 2947 ] {a264fc83-4fa1-4a9b-82ef-819f0763b14b} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.183958012 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:40.475037 [ 2947 ] {a264fc83-4fa1-4a9b-82ef-819f0763b14b} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:45.812953 [ 2945 ] {c23c3af2-7c97-48a1-af28-80f68c09dd8b} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.011456296 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:53756) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:45.815189 [ 3479 ] {0af15fc1-e04a-40b0-a3e3-68ec43e26a4d} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.010269794 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:55792) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:45.827910 [ 1989 ] {6a3439fd-2b1f-4dcf-8395-fe84f2d3b6b8} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.025159362 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33342) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.166480 [ 2945 ] {c23c3af2-7c97-48a1-af28-80f68c09dd8b} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.011456296 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.202070 [ 3479 ] {0af15fc1-e04a-40b0-a3e3-68ec43e26a4d} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.010269794 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.290106 [ 1989 ] {6a3439fd-2b1f-4dcf-8395-fe84f2d3b6b8} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.025159362 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.311216 [ 3396 ] {b1b70ec0-8a4f-4fe2-a0d8-d3d3baa259e3} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.504887133 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40040) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.408371 [ 3396 ] {b1b70ec0-8a4f-4fe2-a0d8-d3d3baa259e3} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.504887133 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.694298 [ 3383 ] {4caf5010-ef5c-4e6f-9d1f-a9141bed96e4} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.890411852 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49208) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.720613 [ 2947 ] {4e7f19a5-734e-415b-872e-f81bb839b413} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.917284457 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51608) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.729964 [ 2362 ] {7f3a69d2-3acc-4f96-be43-3a1639c24e12} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.924674648 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60658) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.751156 [ 3373 ] {92350d42-d1bf-4145-98f3-dba979296144} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.946892821 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51624) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.769946 [ 3383 ] {4caf5010-ef5c-4e6f-9d1f-a9141bed96e4} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.890411852 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.817784 [ 2362 ] {7f3a69d2-3acc-4f96-be43-3a1639c24e12} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.924674648 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.821146 [ 2947 ] {4e7f19a5-734e-415b-872e-f81bb839b413} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.917284457 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.825879 [ 3373 ] {92350d42-d1bf-4145-98f3-dba979296144} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.946892821 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.861842 [ 1990 ] {ef7b754d-e7ec-4cd9-bde8-82bdf54f4b56} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.247276838 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:52716) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.863567 [ 2946 ] {e4b09799-eb1a-476b-b7ff-f82b448cac4c} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.057738862 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:42878) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.891270 [ 3373 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:51624). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:46.892328 [ 2362 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:60658). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:46.897475 [ 1990 ] {ef7b754d-e7ec-4cd9-bde8-82bdf54f4b56} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.247276838 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.955177 [ 2946 ] {e4b09799-eb1a-476b-b7ff-f82b448cac4c} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.057738862 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:46.956112 [ 2946 ] {e4b09799-eb1a-476b-b7ff-f82b448cac4c} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:53.234085 [ 3396 ] {0ff5639d-47f5-4555-ba0c-73c37196680e} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.016013848 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:33354) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:53.253535 [ 2362 ] {aa5da80f-049c-44b9-b524-0fa97183fccb} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.952037288 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:60672) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:53.266811 [ 2947 ] {96a61c0a-7d8e-4e55-b5d1-b6b881ad93fc} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.000013629 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:42882) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:53.312365 [ 1989 ] {df079bae-b16b-4692-8ae2-572d0c417774} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.003372525 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51612) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:53.338802 [ 3481 ] {f8e01951-c340-474e-a8c8-da58eb49b061} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.024475311 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:49210) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:53.341435 [ 2945 ] {64747e3e-f212-4873-87ce-1ae44182bb01} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.06130717 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:51630) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:53.342182 [ 2362 ] {aa5da80f-049c-44b9-b524-0fa97183fccb} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 2.952037288 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:53.350203 [ 3383 ] {300f9c72-7ffc-4f6c-92a1-e33889954976} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.054217186 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:55798) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:53.362623 [ 3396 ] {0ff5639d-47f5-4555-ba0c-73c37196680e} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.016013848 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:53.819657 [ 1989 ] {df079bae-b16b-4692-8ae2-572d0c417774} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.003372525 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:53.901476 [ 3383 ] {300f9c72-7ffc-4f6c-92a1-e33889954976} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.054217186 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:53.913796 [ 3481 ] {f8e01951-c340-474e-a8c8-da58eb49b061} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.024475311 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:53.952407 [ 2947 ] {96a61c0a-7d8e-4e55-b5d1-b6b881ad93fc} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 1.000013629 seconds, maximum: 1: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/QueryPipeline/ReadProgressCallback.cpp:50: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e94511
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d534671
10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d534120
11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d5166a1
12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516a37
13. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5179d8
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517935
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517915
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5178f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5178c0
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
20. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d9882
21. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e36c4
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3695
23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e3679
24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e351d
25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e33e5
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e3355
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e3335
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e3315
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e32e0
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5

2024.11.04 22:58:54.088755 [ 2945 ] {64747e3e-f212-4873-87ce-1ae44182bb01} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.06130717 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:54.276965 [ 3373 ] {c6c74a67-a190-4138-a062-24660878afbb} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.001335272 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:40054) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:54.286336 [ 1990 ] {86f8da71-8fc7-4e61-ba05-a0633dc8ba7b} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.297193101 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::1]:52718) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:54.287887 [ 3479 ] {7fa9b395-fde0-4e2f-8f14-64f64b6f2e0c} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.974277047 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:34478) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:54.296433 [ 2946 ] {cf61198a-d080-45e5-91d7-db6150499989} <Error> executeQuery: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.021074552 seconds, maximum: 1. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable (altinity build)) (from [::ffff:127.0.0.1]:53762) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:54.318253 [ 2945 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:51630). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:54.322158 [ 2362 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:60672). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e772c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e68a0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5f46a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46f277
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4878c5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228b3619
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228b3e68
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a8b194
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a87f3a
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a86c7e
15. ? @ 0x00007fc03cc8fac3
16. ? @ 0x00007fc03cd21850
 (version 24.3.12.76.altinitystable (altinity build))
2024.11.04 22:58:54.324781 [ 1990 ] {86f8da71-8fc7-4e61-ba05-a0633dc8ba7b} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.297193101 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:196: DB::PipelineExecutor::finalizeExecution() @ 0x000000001d515c7f
11. /build/src/Processors/Executors/PipelineExecutor.cpp:131: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d51553e
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
29. ? @ 0x00007fc03cc8fac3
30. ? @ 0x00007fc03cd21850

2024.11.04 22:58:54.361836 [ 3373 ] {c6c74a67-a190-4138-a062-24660878afbb} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.001335272 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:54.362521 [ 3373 ] {c6c74a67-a190-4138-a062-24660878afbb} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:54.371216 [ 2946 ] {cf61198a-d080-45e5-91d7-db6150499989} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 4.021074552 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:54.371945 [ 2946 ] {cf61198a-d080-45e5-91d7-db6150499989} <Warning> TCPHandler: Client has gone away.
2024.11.04 22:58:54.373044 [ 3479 ] {7fa9b395-fde0-4e2f-8f14-64f64b6f2e0c} <Error> TCPHandler: Code: 159. DB::Exception: Timeout exceeded: elapsed 3.974277047 seconds, maximum: 1. (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9b82
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f9b4d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a0b3e0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bbd2e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8f072a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<double, double>(int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e96fcc
6. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:111: bool DB::handleOverflowMode<double, double>(DB::OverflowMode, int, FormatStringHelperImpl<std::type_identity<double>::type, std::type_identity<double>::type>, double&&, double&&) @ 0x0000000019e963d9
7. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:127: DB::ExecutionSpeedLimits::checkTimeLimit(Stopwatch const&, DB::OverflowMode) const @ 0x0000000019e962e8
8. /build/src/Interpreters/ProcessList.cpp:482: DB::QueryStatus::checkTimeLimit() @ 0x000000001b6a6c5e
9. /build/src/Processors/Executors/PipelineExecutor.cpp:186: DB::PipelineExecutor::checkTimeLimit() @ 0x000000001d5155c0
10. /build/src/Processors/Executors/PipelineExecutor.cpp:103: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d514a16
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d53a570
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d53a3df
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a355
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d53a339
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53a29d
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d53a1a7
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d53a115
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d53a0f5
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d53a0d5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d53a0a0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b449b6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b445f5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d60b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133ddb04
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133ddab5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dda7d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dd882
28. ? @ 0x00007fc03cc8fac3
29. ? @ 0x00007fc03cd21850

2024.11.04 22:58:54.373674 [ 3479 ] {7fa9b395-fde0-4e2f-8f14-64f64b6f2e0c} <Warning> TCPHandler: Client has gone away.
2024.11.04 23:10:23.213404 [ 391 ] {} <Warning> Application: Closed all listening sockets. Waiting for 3 outstanding connections.
2024.11.04 23:10:28.118407 [ 391 ] {} <Warning> Application: Closed connections. But 3 remain. Tip: To increase wait time add to config: <shutdown_wait_unfinished>60</shutdown_wait_unfinished>
2024.11.04 23:10:28.118618 [ 391 ] {} <Warning> Application: Will shutdown forcefully.